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Abstract. The well-known Hammersley-ClifTord theorem states (under certain conditions) that any Markov 
^— ^ random field is a Gibbs state for a nearest neighbor interaction. In this paper we study Markov random 

fields for which the proof of the Hammersley-Clifford theorem does not apply. Following Petersen and 
Schmidt we utilize the formalism of cocycles for the homoclinic equivalence relation and introduce "Markov 
cocycles" , reparametrisations of Markov specifications. The main part of this paper exploits this to deduce 
the conclusion of the Hammersley-Clifford theorem for a family of Markov fields which are outside the 
theorem's purview where the underlying graph is Z'*. This family includes all Markov random fields whose 
support is the d-dimensional "3-colored chessboard" . On the other extreme, we construct a family of shift- 
invariant Markov random fields which are not given by any finite range shift-invariant interaction. 

cn 

I — I 1. Introduction 

Q A Markov random field is a collection of random variables {xv)y^v indexed by the vertices of 

an undirected graph G = (V, E), satisfying the following conditional independence property: 
Any two subsets of the variables {xy}y^A and {xv}y^B corresponding to separated subsets 
of vertices A,BGVm the graph are independent given {xy}y<^v\{AuB)- Under a certain 
positivity assumption on the joint distribution, the Hammersley-Clifford theorem states that 
any Markov random field is a Gibbs state for a nearest neighbor interaction. This means 
that the distribution of configurations on any finite subset A (Z V given the configuration on 
00 the outer boundary can be expressed as the normalized product of weights associated with 

^ configurations on complete subgraphs. Moreover, if the measure is invariant under a group 

of automorphisms of the graph, the weights can be chosen invariant under the same. The 
ly-] key assumption in the proof of the Hammersley-Clifford theorem is what we call existence 

O of a "safe symbol" . 

^ In this paper, we shall study Markov random fields outside the purview of the safe symbol 

^ assumption. We focus on Markov random fields which consist of random variables taking 

• ^ values in a finite set A. Thus, a Markov random field on the graph G = (V, E) is a proba- 

^ bility measure /i on , satisfying the conditional independence property described above. 

c3 The support of /i is the smallest closed subset X C A^ such that /i(X) = 1. The support 

X of a Markov random field has a certain property which makes it a "topological Markov 



field" (see section 2.1). A specification is a consistent system of probability distributions 
on configurations for every finite set of sites given the configuration on the complement. A 
Markov specification is a specification where the distribution depends solely on the config- 
uration on the outer boundary of the concerned finite set and Gibbs if it can be written as 
the normalized product of nearest neighbor interactions as well. The Hammersley-Clifford 
theorem is thus a statement about the specification of a Markov random field, under an 
assumption on its support (existence of a "safe symbol"). 
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In general the conclusion of the Hammersely-Clifford theorem does not hold if we drop 
the safe symbol assumption: J. Moussouris provided examples of Markov random fields on 
a finite graph which are not Gibbs states for a nearest neighbor interaction [161- Are there 
other conditions on a Markov random field which guarantee that a Hammersely-Clifford type 
theorem to holds? In the absence of a nearest neighbor interaction, is there an alternative 
"compact description" for the specification of a Markov random field? These are the types 
of questions we investigate in this paper. Some work along these lines has been carried out 
in the first-named author's M.Sc. thesis [5]. 

There has been other work along this direction: When the underlying graph is finite, there 
are known algebraic conditions on the support [12] and conditions on the graph |15] for the 
conclusions of the Hammersley-Clifford theorem to hold. When the underlying graph is a 
Cayley graph of Z the Markov random field is shift-invariant and A is finite, the conclusions of 
the Hammersley-Clifford theorem holds without any further assumptions [B]. Furthermore, 
in that setting any Markov random field is a stationary Markov chain. Even when the 
underlying graph is a Cayley graph of Z, this conclusion can fail for countable A (Theorem 
11-33 IHj), or if we drop the assumption of shift-invar iance [9]. In the same setting, except 
^ is a general measure space rather than a finite set, certain mixing conditions guarantee 
the conclusion (theorems 10.25 and 10.35 in [H]). When the underlying graph is the Cayley 
graph of Z'^ and d > 1, the conclusion fails even in the shift-invariant and finite alphabet 
case (Chapter 5 in [5J and section |9] of this paper). 

For most of this paper we focus on Markov random fields for which the graph G = {V, E) 
is the Cayley graph of Z'' with respect to the standard set of generators. The natural action 
of TJ^ on this graph induces an action on by translations or shifts. We study in particular 
Markov random fields which are invariant to the shift action. Evidently, the support of any 
such Markov random field is a shift space, that is a shift invariant compact subset of A?''^ . 

A major portion of this paper is spent establishing the conclusion of the Hammersley- 
Clifford theorem for Markov random fields whose support is in a certain one-parameter 
family of shift spaces X^, where r > 2 is an integer. We prove that any Markov random field 
whose support is is a Gibbs state for a nearest neighbor interaction (proposition 5.5). 
Furthermore, the interaction ca n be chosen shift-invariant if the concerned Markov random 
field is shift-invariant (theorem 6.1). For r 7^ 4, the space Xr C {0,. . . ,r — 1}^'' consists 
of all those x G {0, . . . ,r — 1}^ for which Xn — Xm = ±1 mod r whenever ||n — m||i = 1. 
For r = 2 this space consists of 2 periodic "chessboard" configurations and for r = 3 this is 
the c?- dimensional "3-colored chessboard" : the set of proper graph 3-colorings of the Cayley 
graph of 1/. 

In section [3] we introduce "Markov cocycles" and "Gibbs cocycles" , a rather general for- 
malism allowing to parameterize Markov specifications. Following [TH] , these are logarithms 
of the Radon-Nikodym derivatives with respect to the homoclinic relation, that is, loga- 
rithm of the ratio of probabilities of configurations which differ at only finitely many sites. 
Markov cocycles form a vector space, the space of Gibbs cocycles with shift-invariant inter- 
actions being finite dimensional. A strong version of Hammersley-Clifford theorem can now 
be stated in terms of these objects (theorem 3.1). A weaker condition on the support of a 
Markov random field than that of a "safe symbol", namely, the "pivot property" gives us 
a weaker result, that is, the space of shift-invariant Markov cocycles is finite dimensional. 
For the 's we show that the dimension of the shift-invariant Markov cocycles is r 
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while the dimension of Gibbs cocycles with a shift-invariant interaction is r — 1 (propositions 



5.2 and 5.3). However if we do not demand shift-invariance for the interaction, then every 
Markov cocycle is Gibbs. Thus for shift spaces X^s the conclusion of the weaker version of 
Hammersley-Clifford theorem holds, the conclusion of the stronger version holds as well but 
not in the shift-invariance setting. We give an example in Section |9] which does not have the 
pivot property and the space of shift-invariant Markov cocycles has uncountable dimension. 

2. Background and Notation 
This section will recall the necessary concepts and introduce the basic notation. 

2.1. Markov Random Fields and topological Markov fields. Let G = {V, E) be a 

graph where the vertex set V is finite or countable. The boundary of a set of vertices F G V, 
denoted dF, is the set of vertices outside F which are adjacent to F: 

OF := {v e V \ F : 3w e V s.t. {v, w) G E}. 

Remark: Observe that in our notation dF C F'^. This is sometimes called the outer 
boundary of a set F. Consistent with our notation the inner boundary of F is dF"^. 

Given A finite (more generally compact), is a compact topological space with respect 
to the product topology. For F C V finite and a E A^, we denote by [ajp the cylinder set 

[a]F = {x G A^ : X \f= a}. 

The collection of cylinder sets generate the Borel cr-algebra on A^ . 

A Markov random field is a Borel probability measure /i on A^ with the property that for 
all finite A,B cV such that OA C B C A" and a G b e A^ satisfying /i([6]ij) > 

fi{[a]A [b]B) = K[(^]a [b\dA]dA)- 

An equivalent definition is the following: If a; is a point chosen randomly according to 
the measure fi, and A,BgV are finite, separated sets in G (meaning (f , w) ^ E whenever 
V E A and w G B), then conditioned on x \v\{Aub), x \a and x \b are independent random 
variables. 

Remark: A stronger notion of a Markov random field obtained by requiring the condi- 
tional independence above for all A,B(ZV which are separated in G, finite or not is called a 
global Markov random field. We will not discuss this distinction further here, and be mostly 
concerned with the definition of Markov random fields where the above mentioned A and B 
are finite. 

As in [HI E] , a topological Markov field is a compact set X C A^ such that for all F C 
finite, and all x,y E X satisfying x = y on dF, z G Ay given by 



Xy for t> G F 
y^ ioY V eV \ F 

is an element in X. A topological Markov field is called global if we do not demand that F 
be finite. 

The support of a Borel probability measure /i on Ay denoted by supp{fi) is the intersection 
of all closed sets Y C A^ for which fi(Y) = 1. Equivalently, 

supp{ii) = A^ \ y [a] A, 
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where A/'(/i) is the collection of all cylinder sets with /i([a]yi) = 0. It follows that the support 
of a Markov random field is a topological Markov field. 



2.2. The homoclinic equivalence relation of a TMF and adapted MRFs. Following 
[IHIET^, we denote by Ax the homoclinic equivalence relation of a TMF X C , which is 
given by 



We say that a Markov random field /i is adapted with respect to topological Markov field 
X if supp{fi) C X and 



Equivalently, a Markov random field /i is adapted to X if and only if the measure /i is 
non-singular with respect to Ax. 

To illustrate this definition, if supp{fi) = X then /i is adapted with respect to X, and if 
X = Xi U X2 is the union of topological Markov fields over disjoint alphabets and /i is a 
Markov random field with supp{n) = Xi then fi is adapted with respect to X. On the other 
hand, the Bernoulli measure (^5o + is not adapted with resect to {0, 1,2}^. In fact, 

if X = A^"^ then any Markov random field which is adapted to X has supp{fi) = X. 

2.3. Z'^-shift spaces and shifts of finite type. For the Markov random fields we discuss 
in this paper, the vertices of the underlying graph are the dimensional integer lattice. 
We identify Z'^ with the set of vertices of the Cayley graph with respect to the standard 
generators. Rephrasing, ra,m G Z"^ are adjacent iff \\n — m\\i = 1, where for any 
n = (ni, . . . ,nr) G Z*^, ||n||i = Ylt=i l^^^l denotes the li norm of n. The boundary of any 
finite set F C Z*^ is thus given by: 



define a Z'^-action by homeomorphisms, called the shift-action. The pair {A^ ,a) is a topo- 
logical dynamical system called the d-dimensional full shift on the alphabet A. Note that a 
acts on the Cayley graph of Z'^ by graph isomorphisms. 

A Z'^ shift space or subshift is a dynamical system (X, a) where X C A^ is closed and 
invariant under the map (T„ for each n G Z*^. 

The language of a subshift X denoted by B{X) is defined as all finite patterns which occur 
in the elements of X. For W C Z'^ let 



Ax := {{x,y) G X x X | x„ = ?/„ for all but finitely many n G V}. 



X G supp{n) 



{y G X I (x, G Ax} C supp{fi). 



OF = {m ^ F'^ \ \\n — m\\i 
On the compact space A^'' the maps cr„ : A^'^ 






n e A 
n e B. 
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A Borel probability measure /i on is shift-invariant ii ^ o Un = ^ for all n G 7/. It 
follows that the support of any shift-invariant measure is a subshift. 

An alternate equivalent definition for a subshift is given by forbidden patterns as follows: 
Let 

A* = {A^ \W isa finite subset of Z'^}. 

For any T C A* let 

Xjr = {x G A^ I no translate of a subword of x belongs to J-"}. 

Evidently, a subset X C A^'' is a subshift if and only if there exists J-' G A* such that 
X = Xjr. The set T is called the set of forbidden patterns for X. A subshift X is called a 
shift of finite type if X = Xjr for some finite set J-". A shift of finite type is called a nearest 
neighbor shift of finite type if X = Xj: where J-" consists of nearest neighbor constraints, 
i.e. J-" consists of patterns on edges. When d = 1 nearest neighbor shift of finite type are 
also called topological Markov chains. In fact the study of nearest neighbor shifts of finite 
type has been much motivated by the fact that the support of stationary Markov chains are 
one-dimensional nearest neighbor shifts of finite type. 

Every nearest neighbor Z'^-shift of finite type is a shift-invariant topological Markov field. 
When d = 1 the converse is also true under the assumption that the subshift is non-wandering 
[B]. Without the non- wandering assumption, one-dimensional shift-invariant topological 
Markov fields are sofic shifts, but not necessarily of finite type [6]. This does not hold 
in higher dimensions ( [5] and section [9]) . 



2.4. Gibbs states with nearest neighbor interactions. For a graph G = (V, E) and 
any set A (ZV, let diam{A) denote the diameter of A with respect to the graph distance in 
G, that is, diam{A) = maxjjg^ \\i — 

Following [19], an interaction on X is a function from B{X) to M, satisfying certain 
summability conditions. Here we will only consider finite range interactions, for which the 
summability conditions are automatically satisfied. 

An interaction is of range at most k if 0(a) = for a G Ba{X) whenever diam{A) > k. 
We will call an interaction of range 1 a nearest neighbor interaction. When G = Z'^, an 
interaction is shift-invariant if for all n G Z'^ and a G B{X), V{a) = V^(cr„(a)). Since the 
standard Cayley graph of Z'^ has no triangles, a shift-invariant nearest neighbor interaction 
is uniquely determined by its values on configurations on {0} ("single site potentials") and 
on configurations on pairs {0,6,}, i = 1,. . . ,d ("edge interactions"). We denote these by 
0([a]o) and 0([a,6]j) respectively where a,b E A. 

A Gibbs state with a nearest neighbor interaction is a Markov random field fi such that 
for all X G supp{fi) and A,B G Z'^ finite satisfying dA G B G A'^ 

fi{[x\A [x\b) = ^ 

where Za^xIqa uniquely determined normalizing factor so that /i(X) = 1, dependent 

upon A and x\dA- 
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3. Markov specifications and Markov cocycles 



Any Markov random field fi yields conditional probabilities of the form h{xf = ■ \ xgp = ^) 
for any finite F G V and all admissible 6 G A^^ ( by admissible we mean > 0). 

We refer to such collection of conditional probabilities as the Markov specification associated 
with fi. It may happen that two distinct Markov random fields have the same specification, 
as in the case of the 2-dimensional Ising model in low temperature [T7]. In general it is a 
subtle and challenging problem to determine if a given Markov specification admits more 
than one Markov random fields (the problem of uniqueness for the measure of maximal 
entropy of a Z'^-shift of finite type is an instance of this problem [^). For the purpose of our 
study and statement of our results, it would be convenient to have an intrinsic definition for 
a Markov specification, not involving a particular underlying Markov random field. 

Let X C be a topological Markov field. A Markov specification on X is an assignment 
for each finite F G 7/ and x G EgpiX) of a probability measure Qf,x on Ef{X) satisfying 
the following conditions: 

(1) Support condition: For any finite F G V , any x G EgpiX) and any y G Bf{X) 
such that X V y G BpyjaFiX), QF,x{y) > 0. This condition can be written as follows: 

supp{Qf,x) = {yeBF{X) : X V y G BpudFiX)}. 

(2) Markovian condition: For any finite F G V and x G BgpiX), Qf,x is a Markov 
random field on the finite graph induced from V on F. 

(3) Consistency condition: If F G H, x e BgriX), y G Bqh{X) and Xn = y-n for 
nedFn dH, then for any z G Bf{X) 

. . _ QH,y{[zy x]FudF) 
QH,y{[x\dF) 

The definition above have been set up so that for any Markov random field fi with X = 
supp{fi), the conditional probabilities on Bf{X) obtained by conditioning on dF is indeed 
a Markov specification. Conversely, given any Markov specification on X there exists a 
Markov random field /i on X compatible with 9 in the sense that /x([a]i? | [y]dF) = ^F,y{(i), 
whenever fJ'{[y]dF) > [H]. Furthermore, for a specification which is shift- invariant, it 
follows from amenability of Z*^ that there exists a shift-invariant Markov random field /x 
compatible with G. However, in general it is possible that for a given specification B the 
support of any /i satisfying the above is contained in a strict subset of X, in which case 
there exist certain finite F G V and configurations y G BgF{X) for which the conditional 
probabilities ij.{[x]f \ [y]dF) are meaningless. We will provide such examples in Section [6j In 
such a case, according to our definition, the specification of /i would be the restriction of G 
to the support of /i. 

It will be convenient for our purposes to re-parameterize the set of Markov specifications 
on a given topological Markov field X. For this purpose we use the formalism of A^-cocycles. 
To this well-known formalism we introduce an ad-hoc definition of a Markov cocycle, which 
we now explain. As in [21], a (real-valued) Ax-cocycle is a function M : Ax — y M satisfying 

(3.1) M{x,z) = M{x,y) + M{y, z) whenever {x,y), {y, z) G Ax. 

A Ax-cocycle is shift-invariant if M{x,y) = M(o"„(a;), cr„,(?/)) for all n G Z'^. We call M a 
Markov cocycle if it is a Ax-cocycle and satisfies: For any {x,y) G Ax, M{x,y) depends 
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only upon the sites on which x and y differ and its boundary i.e. if F is the set of sites on 
which X and y differ then 

M{x,y) = C(^|^ueF,?/lFUSF)- 

There is a clear bijection between Markov cocycles and Markov specifications on X: If G 
is a Markov specification on X, the corresponding Markov cocycle is given by 

M{x,y) = log {&F,y\gp{y If)) - log (G^.^ia^ (a; \f)) , 

where (x, y) G Ax and F dlf- finite such that Xn = yn for n G F'^. 

Conversely, given a Markov cocycle M on X, the corresponding specification B is given 

by 

Of Ay) = -^e^(-^^'-^^), 

■^M,F,a 

where F C Z"^ is a finite set, a G Bgp{X), y,z E Bp{x) are such that a\J x,a\J z G BpyjaFiX) 
and X G Bpc[X) with x \dF= a. The normalizing constant ZM,F,a is given by: 

Note that the expression for the specification is well defined since X is a topological Markov 
field. 

This bijection clearly maps shift-invariant specifications to shift-invariant Markov-cocycles. 
Thus, a shift-invariant Borel probability measure /i is a shift-invariant Markov random field 
if and only if X = supp{fi) is a topological Markov field and there exists a shift-invariant 
Markov cocycle M on X such that for all {x,y) G Ax 

/^(Wa) 

for any A D F U dF where F is the set of sites on which x, y differ. 

In the above situation the function p : Ax — )■ given by p{x,y) = e*^^^'^-* is the 
Ax-Radon-Nikodym cocycle of p as in [IS], p is a clearly a cocycle taking values in the 
multiplicative group IR+. 

Given a topological Markov field X, the Gibbs cocycle corresponding to a nearest neighbor 
interaction is the Ax-cocycle given by: 

M{x,y)= (j){y\w) - (j){x\w)- 

WCV finite 

Note that M is well defined since there are only finitely many non-zero terms in the sum 
whenever {x,y) G Ax- Evidently, any M of this kind is a Markov cocycle. Our point of 
interest is the converse. Note that a Borel probability measure /i is a Gibbs state with nearest 
neighbor interaction if and only if its Ax-Radon-Nikodym cocycle is e'^^ for the Gibbs cocycle 
M on X = supp{fi). 

Let X be a topological Markov field. We shall denote by A^x the set of all Markov cocycles 
and by Qx the set of all nearest neighbor Gibbs cocycles. In case X is also a subshift, we 
denote by A^x the set of shift-invariant Markov cocycles and by Qx the set of Gibbs cocycles 
corresponding to a shift-invariant nearest neighbor interaction. 
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The set Aix of Markov cocycles naturally carries a vector space structure since given 
Ml, M2 e Mx and Ci, C2 G M, 

CiMi + C2M2 e A^x- 

It can be seen that Qx is a subspace of A^x- Since shift-invariant nearest neighbor 
interactions constitute a finite-dimensional vector space Qx d M.x has finite dimension. We 
would like to note here that for finite graphs the condition under which a given Markov 
cocycle is Gibbs is very similar to the 'balanced' conditions mentioned in [16] . 

3.1. The "safe symbol property" and the Hammersley-Clifford Theorem. A sub- 
shift X on alphabet A is said to have a safe symbol if there exists an element -k E A such 
that for all X G X and A dT/, y & J?' given by 



Vn 



Xn for G A 
for n G v4^. 



is also an element of X. 

A formulation of the Hammersley-Clifford Theorem states: 

Theorem. (Hammersley-Clifford, weak version [13]^ Let X he a topological Markov 
field with a safe symbol. Then: 

(1) Any Markov random field with supp{fi) = X is a Gibbs state for a nearest neighbor 
interaction. 

(2) Any shift-invariant Markov random field on X is a Gibbs state for a shift-invariant, 
nearest neighbor interaction. 

The second statement in the theorem above is not a part of the original formulation, 
but does follow since there is an explicit algorithm to produce a nearest neighbor interaction 
which is invariant under any graph automorphism for which the original Markov random field 
was invariant [S]. See also PQ , [23] , [21] • It is in general false that a shift-invariant Markov 
random field whose (shift-invariant) specification is compatible with some nearest neighbor 
interaction must also be compatible with some shift-invariant nearest neighbor interaction 



(see corollary 5.6 below). In particular, for a general topological Markov field X we have 
Gx -^x ^ Gx, but the inclusion may be strict. 

An inspection of the original proof of the Hammersley-Clifford theorem actually gives the 
following a priori stronger result: 

Theorem 3.1. (Hammersley-Clifford Theorem, strong version) Let the X C A^'^ 
be a topological Markov field with a safe symbol. Then: 

(1) Any Markov cocycle on X is a Gibbs cocycle given by a nearest neighbor interaction. 
In our notation this is expressed by: Aix = Qx 

(2) Any shift-invariant Markov cocycle on X is a Gibbs cocycle given by a shift- invariant 
nearest neighbor interaction. In our notation this is expressed by: Aix = Qx- 

It is easily verified that any topological Markov field X which satisfies one of the conclu- 
sions of the "strong version" immediately satisfies the corresponding conclusion of the "weak 
version" . We will demonstrate in the following section that the converse implication is false 
in general. 

For X with a safe symbol, the "strong" and "weak" versions are easily equivalent because 
of the following simple claim: 
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Proposition 3.2. Let the X C J?''^ he a topological Markov field with a safe symbol. Then 
any Markov random field fi adapted to X has supp{fi) = X . 

Proof. Let yU be a Markov random field adapted to X. We need to show that for any finite 
F C and any a E Bf{X), fx{[a\F) > 0. Denote F = FUdF. Let b E Bp{X) and 
c E Bqp{X) satisfy fi{[b V c]^^^^) > 0. In particular, /i([c]g^) > 0. Let b E Bp{X) be given 
by 

bn n E F 
n E OF. 



bn 



The configuration 6 V c is admissible in X, because is a safe-symbol. Again, by the safe 
symbol property it follows that d E Bp{X) where: 

n nEF 
n E OF. 

Since X is a topological Markov field, a V c G BpyjQp{X). Since fi is an adapted Markov 
random field it follows that | [c]gp) > 0, and since /x([c]g^) > it follows that 

/i([a V c]pfjQp) > 0, so in particular fi{[a]F) > 0. □ 



Remark: Proposition 3.2 is a particular instance of the more general fact that any A^- 
nonsingular measure fi satisfies supp{^) = X, whenever Ax is a topologically minimal. The 
latter condition means the Ax equivalence class of any x G X is dense in X. 

Remark: When the underlying graph is Z*^, any shift-invariant topological Markov field 
X with a safe symbol is actually a nearest-neighbor shift of finite type. This follows using 



arguments similar to those appearing in the proof of proposition 3.2 



3.2. The Pivot Property. We shall now consider a weaker property than that of having 
a safe symbol. Let X be a topological Markov field. If x,y E X only differ at a single 
n E Z'^, then the pair (x, y) will be called a pivot move in X. A subshift X is said to have the 
pivot property if for all (x, y) E Ax such that x ^ y there exists a finite sequence of points 
x^^^ = x,x^'^\ . . . , x*-'^^ = y E X such that each (x x*^*"*"^^) is a pivot move. In this case we 
say x*^^^ = X, x^'^\ . . . , x'-'^-* = y is a, chain of pivots from x to y. Sometimes in the literature 
the pivot property is called "local move connectedness". This condition is the same as (3) 
in Theorem 4.1 of [3]. Here are some examples of subshifts which have the pivot property: 

(1) Any subshift with a trivial homoclinic relation. 

(2) Any subshift with a safe symbol. 

(3) The "3-colored chessboard" (see below). 

(4) r-colorings of Z'^ with r > 2d + 2. 

Proposition 3.3. Let X be any subshift with the pivot property. Then the dimension of 
finite. 

Proof. Let (x, y) E Ax- Let x = x'--'^^ x^'^\x^'^\ . . . , x^'^-' = y he a chain of pivots from x to y. 
Then 

k-l 

(3.2) M(x, y) = J2 M{x'^'\ x'^'+^^). 

i=l 
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If a;W,x(^+^) differ only at G Z'^. Then M(xW,x(*+^)) = M(a_^^xW, depends 
only on cr_m^x*^*^|{o}ua{o} and cr_m-X^*+^^|{o}u5{o}- Therefore the dimension of the space of 
shift-invariant Markov cocycles is bounded by |i3{(o,o)}U(9{(o,o)}P- D 

Remark: More generally, the same proof shows that dim(A^x) < oo whenever there are 
a finite number of maps /i, . . . , : X — )• X and a finite F G Z'^ so that {fi{x))n = Xn 
whenever n ^ F and A^. is the orbit relation generated by 

Wn^ ° fi°(^n ■ neZ"^, i = l,...,k}. 

This corresponds to subshifts with the "generalized pivot property" or "local move connect- 
edness": A generalized pivot move from x G X to ?/ G X is defined when x and y differ 
only in a fixed finite set F C Z"^. "Domino tiles" are an interesting and well known and 
interesting example for a subshift with the generalized pivot property [TU]. 

4. Zr-HOMOMORPHISMS, 3-COLORED CHESSBOARDS AND HEIGHT FUNCTIONS 

Recall that a graph-homomorphism from the graph Gi = {Vi,Ei) to the graph G2 = 
(V2, E2) is a function f : Vi ^ V2 from the vertex set of Gi to the vertex set of G2 such that 
/ sends edges in Gi to edges in G2. Namely, if {v,w) G Ei then (/(f), f{w)) G -^2- 

For the purposes of this paper, a height function on Z'' is graph homomorphism from the 
standard Cayley graph of Z'' to the standard Cayley graph of Z. Equivalently, a height 
function is a function x G Z^ such that for any two adjacent sites m, n G Z^, \xm — £n| = 1- 
Let Ht^'^'' C Z^'' denote the set of height functions on Z*^. 

We now introduce a certain family of Z^'-shifts of finite type Xr'^\ where r, d G N, and 
r > 1: Denote by Z^ = Z/rZ = {0, . . . , r — 1} the finite cyclic group of residues modulo r. 
Let (pr : ^t^'^^ ^ (Z^)^"* be defined by 

4'r{x)n = Xn mod r for n G Z*^. 
The Z'^ subshift Xr'^^ is defined by: 

Xl''^ = (t)r{Ht^^^). 

For r = 2 it is easily verified that X^"^ consists precisely a two points x^""^", x°'^'^. These are 
"chessboard configurations", given by x'^^^ = l[||n||=o mod 2] and x'^'^ = l[||ni|=i mod 2] where 
1 is the indicator function. 

For r 7^ 1, 4, there turns out to be a direct and simple interpretation for the subshift Xr*^^ 
as the set of graph homomorphisms from the standard Cayley graph of Z*^ to the standard 
Cayley graph of Z^.. This is expressed by the following proposition. 

Proposition 4.1. For any d > 2 and r G N \ {1,4}, Xr^^ is a nearest neighbor shift of finite 
type given by 

X^'^^ = {x E (Zr)^'* : x„ — Xm = ±1 mod r, whenever \\n — m\\i = 1}. 

Proof. When r = 2, by our previous remark X2'^^ = {x"'^ , x'^'"^^} , and the claim of the 
proposition is easily verified. Thus, from now assume r G N \ {1,2,4}. Temporarily, let us 
denote 

Y}^^ = {x G (Zr)^ : Xn — Xm = ±1 mod r, whenever \\n — m\\i = 1}. 
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The claim we need to establish is that Yr = Xr \ where Xr = (f)r{Ht^^^). For any 

X G Ht^'^^ and m,n & 'Z'^ with \\n — m\\i = 1, by definition of Ht^'^\ we have | 

Thus, 0r(a;)n — 4>r{i)m = ±1 niod r, and so (prix) G The inclusion Xr''''' C Yr''^ is 

established. 

It remains to be shown that the map ipr '■ Ht'^'^'' Y^^ is surjective: 

Fix some enumeration 7/ = {ni,n2, ■ ■ ■}, so that rii is adjacent to some nj for j < i. A 

"breadth-first search" of the Cayley graph of Z'^ is one way to obtain such an enumeration. 

Given x G Xr"^-*, set x^ = Xm, and recursively define x^^-^ = Xn^ + — where 

Xn^ = 1 mod r 
Xn^ = —1 mod r 

To see that — Xm| = 1 whenever ||r2 — m|| = 1, it is sufficient to prove that the resulting x is 
independent of the choice of enumeration rii, n2, . . . provided it starts with rii. Equivalently, 
we need to show that whenever mo, mi, . . . , rriT G Z"' satisfy Hm^— mfc_i|| = 1 for k = 1, . . . ,T 
and niQ = ttit, we have X]fc=i[^mfc ~ ^mfe.J = 0. We can further reduce this to proving the 
above for T = 4, since cycles of length 4 are a basis for all cycles in the Cayley graph of Z"^ 
(equivalently, for any two paths p and q in the Cayley graph of Z*^ with common start and 
end points there is a "discrete homotopy" from one to the other). Thus, the proof reduces 
to the claim that for all x G Xr'^'* and any i,j G {1, . . . ,d} : 

where addition and the equality is in Z. This equality clearly holds modulo r. Also, the 2 
summands in each side are both in {±1}. Since r G N\{1, 2, 4}, whenever A, B,C,D G {±1} 
and A + B = C + D mod r, it follows that A + B = C + Das integers. Thus, the claim 
holds. 

□ 

In the particular case r = 3 , Xg'^'' is a presentation of a shift of finite type known as 
the (i-dimensional 3-colored chessboard. The subshift Xg'^^ is the set of {0, 1, 2}-colorings of 
Z'^ in which neighboring sites have distinct color. For simplicity, in the upcoming sections 
the reader can restrict to the case r = 3 and d = 2 so Xr''^ is the 2-dimensional 3-colored 
chessboard. 

The essential part of this proof, in a slight reformulation amounts to proving that a certain 
shift-cocycle over Xr^-* is well defined, as in [20l [22] . Similar methods will be employed to 
realize the basis of the space of shift-invariant Markov cocycles on the spaces Xr'^^ in section 

El 

We remark that in the exceptional case r = 4, the same arguments show that X^'^'' is still 
a shift of finite type, although not nearest neighbor, and we have: 

{x G (Zf.)^'* I Xn — Xm = ±1 mod 4, whenever ||?t, — m||i = 1 

and [Xq — XeJ + [Xe, — Xgj+ej] = [^^0 ~ ^Cj] + [Xcj ~ ^ei+e^ 

for all i and j}. 



-x„.| = { 
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Lemma 4.2. Fix any d > 2 and r G N \ {1,2}. For x G xi'^^ any two pre-images under 
(pr differ by a constant integer multiple of r, that is, if (f)r{x^^^) = (f)r{x^'^^) then there exists 
M eZ so that xi!^ - x^n^ = rM for all n eZ'^. 

Proof. As in the proof of proposition 4.1 , fix some enumeration Z*^ = {ni, n2, • • •}, so that Ui 



is adjacent to some nj for j < i. 

The proof that any two pre-images differ by a constant integer multiple of r can be carried 
out by a simple induction: Induct on G N to show that if 0r(a;) = (pr{y) then 

•^rife Vnt; ^ni Vni ^ rZ. 

□ 

In the following, to avoid cumbersome superscripts, we will fix some dimension d >2, and 
denote Ht := Ht'^'^l xl'^^ := X.. 



By following the arguments in the proof of lemma [472] it follows that if x, y G Ht such that 
^no — Vno for some Uq G Z'^. Then a; = ^ on the connected component of 
{m\(l)r{x)m = (pr{y)m} Containing uq. Note that if two height functions x,y E Ht differ at a 
unique n E Z'^ then \xn — Vnl =2 . 

Corollary 4.3. For any {x,y) G Ax^, there exist {x,y) G Afft so that 4>r{x) = x and 
(f)r{y) = y- The differences x„ — y„, are an integer multiple of r independent of the chosen 
(x, y) G Ant for all n E Z'^ where Xn = y-n- Also, for all n eN, (x„ — y„) G 2Z. In particular 
if for x,y E Xr, x = y at all sites except some given site no E Z^ , then there exists x,y E Ht 
such that 0r(x) = X, (priy) = y and 



|Xn i/n] 



2 if n = no 
otherwise 



It is a known and useful fact that the 3-colored chessboard has the pivot property. This 
can be shown, for instance, using height functions. Essentially the same argument shows 
that Xr has the pivot property. We include a proof below, both for completeness and because 
similar arguments appear in the proofs of certain claims in the subsequent sections: 

Proposition 4.4. For any d >2 and r G N the subshift X^ has the pivot property. In other 
words, given any {x,y) E Ax,, there exist points x = z'''^\ z^^\ . . . , z^'^^ = y E X^ such that 
for all < k < N , there is a unique Uf^ E Z*^ for which Zn^ 7^ ^nj^ ^ ■ 



Proof. By corollary 4.3, given {x,y) E Ax,, choose homoclinic height functions {x,y) E A^t 



with (f)r{x) = X and (j)r{y) = y- We will proceed by induction on D = XlneZ'* 1-^" ~ Note 



that by corollary 4.3 this is well defined, that is, the differences (x„ — in the sum do not 
depend on the choice of {x,y). When D = 0, then x = y and the claim is trivial. Now, 
suppose D > 0. Let 

F+ = G Z^ : (x„ - yn) > 0} 

F_ = {n G Z^ : (x„ - y„) < 0}, 

that is, C Z"^ is the finite set of sites where x is strictly above y and F_ C Z'^ is the 
finite set of sites where y is strictly above x. Without loss of generality assume that is 
non-empty. Since (x„ — y„) G 2Z, for all n E F+, Xn — yn> 2. Let uq E F+ be the site such 
that Xno = max{x„ : n E F^}. It follows that Xn^ — Xm = 1 for all m neighboring no. We 
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can thus define z G Hi which is equal to x everywhere except at no, where i„o = — 2. 
Now set z^"^^ — (pri^) and apply the induction hypothesis on {z^^\y). □ 

5. Markov cocycles on Xr 

Our goal in the current section is to describe the space of shift-invariant Markov cocycles 
on Xr, when r e N \ {1, 2}, and the sub-space of Gibbs-cocycles for shift-invariant nearest 
neighbor interactions. 

Lemma 5.1. Let F be a finite set F <Z and x,y,z,w e X^ such that for all n e F'^, 
Xn = Un (ind Zn = Wn and for all n E F U dF, ,t„ — Zn and Un = Wn- Let {x, y) G ^Ht (ind 
{z, w) G Ant be homoclinic pairs of height functions projecting via <pr to [x, y) G Ax^ and 
{z, w) G Ax^ respectively. Then Xn — ijn = ~ for all n G Z''. 

Proof. Let Fq C Z"^ denote the infinite connected component of F^. For n G -Fq, we clearly 
have Xn — yn = Zn — Wn = 0. We can now prove the required by induction on the distance 
from n G Z'' to Fq that 

~ Vn — ~ ^n- Given n G \ Fq, find a neighbor m oi n which 
is closer to Fq. By the induction hypothesis, Xm — ym — ~ Wm- 

If either n E F or m & F, then both m and n are in F U dF and so Xn — x^ — Zn — Zm 

and ijn- Vm = Wn - Wm, which implies x„ = - and ijn - Vm = Wn - Wm- 

Subtracting the equations and applying the induction hypothesis, we conclude in this case 

that Xn ijn — Zn Wn- 

Otherwise, n,m E F^ and so Xn — Xm — iln — Vm and Zn — Zm — Wn — Wm, and again we 
conclude that Xn — yn — Zn — Wn- □ 



For i e Zj. and integers a, b with a — 6 G 2Z, let 
Niia,b)^ 



\{m e {2Z + a) n {rZ + i) : m e [a,b)}\ if a < 6 
—Ni{b,a) otherwise 



Here Ni is the "net" number of crossings from (i -|- rZ) to {i + 2 + rZ) in a path going from 
a to 6 in steps of magnitude 2. Note that 

(5.1) Ni{a,b) = Ni{a + rn,b + rn) 
for all a,b,n & Z and 

(5.2) Ni{a, b) = Ni{a + c,b + c) 

for all i G {0, 1, . . . , r — 1} and a, 6, c G Z such that a — 6 G rZ n 2Z . 

Proposition 5.2. For any r G N \ {1, 2}, the space shift-invariant Markov cocycles 

on Xr has the linear basis: 

{Mo,Mi,...,M,_i}, 

where the cocycle Mi is given by 

(5.3) Mi{x,y) = J2 Nii^n,yn), 

with {x,y) G Ant height functions projecting to {x,y) via 4>r- In particular, dimA4^^ = r. 

13 



Proof. By Corollary 4^ the function Mj's are independent of the choice of corresponding 
height functions and hence are well defined. We will first show that for i = 0, ... ,r — 1, 
Mi is indeed a shift-invariant Markov cocycle. Since Ni{a,c) = Ni{a,b) + Ni{b,c) whenever 
a = b = c mod 2, it follows that Mi{x,z) = Mi{x,y) + Mi{y,z) whenever x,y,z G Xr are 
homoclinic so Mj is a A^^-cocycle. Clearly, Mj is shift-invariant. 

It remains to show that Mj satisfies the Markov property. This is equivalent to showing 



that Mi{x,y) = M Az, w ) whenever x,y,z,w G Xr satisfy the assumption in lemma 5.1, In 



this case by lemma 5A, Xn — yn = Zn — Wn for all n G Z'^. Also note that for any n E 7/, 
either x„ = Zn and ?/„ = Wn in which case Xn — Zn = yn — Wn & rZ or Xn = Vn and Zn = Wn, 
in which case Xn — yn = Zn — Wn G rZ fl 2Z. By equations |5.1| and |5.2| in either case 
Xi{xn,yn) = Xi{zn,Wn) and summiug over all n's, indeed Mi{x,y) = Mi{z,w) as required. 

To complete the proof we need to show that any shift-invariant Markov cocycle on Xr 
can be uniquely written as a linear combination of Mq, . . . , Mr-i- For z G {0, . . . , r — 1} let 
(^2;W^y(«)) g be homoclinic points such that Xq^ = i, y^^ = i + 2 mod r and Xn^ = y^n 
for all n E Tj'^ \ {0}. Given a shift-invariant Markov cocycle M, let := M (x^^\ y^"^^) . We 
claim that for this choice, M = X]I=o '^i ' ^i- Since Xr has the pivot property (proposition 



4.4), by equation 3.2 it is sufficient to show that for any {x,y) G A^^ which differ only at a 
single site , 

r-l 

M{x,y) = Y,(^i-Mi{x,y). 

By shift-invariance of M and the Mj's it is further enough to show this for (x, y) which 
differ only at the origin. In this case, it follows since {x,y) coincide with (x*^*-*, y*^*^) on 
the sites {0} U d{0} for some i, and since M and the Mj's are Markov cocycles we have 
M{x,y) = M(xW,?/W) = Oj and 

■r— 1 r—1 r—l 

5^ a, ■ M,{x,y) = 5^a,M,(x«,y«) = J^a.^y = ftj. 

j=0 j=0 j=0 

□ 

Remark: Without the assumption of shift-invariance, a similar argument shows that 
any Markov cocycles on Xr is of the following form: 

r-l 

M(x, = ai^nNi{x, y) with aj,„ G M for all n G Z'^, l<i< r. 

We now describe the space Q^^ of Gibbs-cocycles corresponding to shift-invariant nearest 
neighbor interactions for Xr- 

Proposition 5.3. A shift-invariant Markov cocycle on Xr is a Gibbs cocycle corresponding to 
a shift-invariant nearest neighbor interaction if and only if it is of the form M = YliZo ca^ij 
with 'Y^\Zq «j = and Mi 's as in proposition \5.^ In other words, 

r—l r—l 

i=0 i=0 

In particular, dim(^^^) = r — 1. 
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Proof. Let M be a Gibbs cocycle given by a shift-inv arian t nearest neighbor interaction 0. 



Choose (x*^*-*, y*^*-') G as in the proof of proposition 5.2 Expanding the Gibbs cocycle by 
definition we have: 

M(a:»,l/») = 0([^ + 2]o)-0([2]o) 
d 

+ i^il' + 2,^ + lb) - ^ + lb) + + 1, ^ + 2],) - + l,«b)) • 
Now summing these equations over i we get: 

1 — 1 r— 1 

i=0 i=0 

Conversely, for any values ai = M {x^^\ y^^^) such that X]i=o '^j = it is easy to see that 
there is a solution to the linear equations on the values of 0. For instance, set i + l]i) = 
- EI=I « + l]i) = for j = 2, . . . , and + 1, = 0([i]o) = for j = 1, . . . , d 

and 2 = 0, ...,r — 1. □ 

Let M : A^^ — )■ M be the Markov cocycle given by 
(5.4) M{x,y) =J2yn-Xn, 

where (x, y) satisfy (f)r{x) = x and (priv) = V- It is easily verified that M = ^[Zg M^. 
Corollary 5.4. ^nt/ shift-invariant Markov cocycle M on Xj. can be uniquely written as 

M = Mo + aM 



where Mq is some Gibbs cocycle, a eM. and M is given by (5.4). 



Thus, the conclusion of the second part of the strong version of the Hammersley-Clifford 
theorem, regarding shift-invariant Markov cocycles fails for Xr. Our next proposition asserts 
that the conclusion of the first part of the strong version of the Hammersley-Clifford theorem 
still holds for X^. This immediately implies the conclusion of the first part of the weak version 
of the Hammersley-Clifford theorem of X^. 

Proposition 5.5. (Mxr = Gx,.) 

Let M : Ax^ — > M &e a Markov cocycle. There exists a nearest neighbor interaction (f), 
which is not necessarily shift-invariant, so that M is given by the interaction (f). 

Proof. Given M G A^x, ? will define a compatible nearest neighbor interaction V. For 
n = {ni . . . , Ud) G I/, and 1 < j < c?, let (pnjio,, b) denote the weight the interaction assigns 
the configuration (a, b) on the edge (n, n -\- Cj). Set 4>n,j{o-, b) = whenever j G {2, . . . , d}. 
For n = (ni, . . . , n^) G Z'^ and i E Zr define 

(l)n,i{i,i + 1) = 



ni<0 
M{any^'\ a„x«) + (f)n-e,,l{^ + 1, ^ + 2) n, > 



'MA 



ni>0 

M{an+e^y^'\ CTn+eiX'^''>) + 0„+ei,l(^ + 2, Z + 1) Hi < 
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where as in the proof of proposition 5.2, {x^^\y^) G Ax^ are such that = i mod r, 
y^^ = i + 2 mod r and Xn^ = yli^ for all n ^'L^\ {0}. This is well defined by induction on 
|ni|. By direct computation it follows that 

d 

(5.5) M(x,y)= 



whenever x and y differ only in a single site. Note that the expressions in both sides of (5.5) 



are Ax^-cocycles. Thus by the pivot property of Xr (proposition 4.4) the equality in (5.5) 
holds for any {x, y) G Ax^. □ 

Combining the above results we obtain: 

Corollary 5.6. There exists a shift-invariant Markov cocycles on Xr which is given by a 
nearest interaction but not by a shift-invariant nearest neighbor interaction. That is, 

6. Markov random fields on Xr are Gibbs 

Our main goal is to prove the following result: 

Theorem 6.1. Any shift-invariant Markov random field adapted to Xr is a Gibbs state for 
some shift-invariant nearest neighbor interaction. In particular any shift-invariant Markov 
random field such that its support is Xr is a Gibbs state for some shift-invariant nearest 
neighbor interaction. 



Theorem 6.1 implies that the conclusion of the second part of the weak version of 
Hammersley-Clifford theorem holds for Xr, although the argument is very different from the 
safe-symbol case. 

For a subshift X, a point x G X will be called frozen if its homoclinic class is singleton. 



This notion coincides with the notion of frozen coloring in [3]. By proposition 4.4 Xr has 



the pivot property so x G Xr is frozen if and only if for every n G Z , xj 7^ x^ for some 
j, k G (9{n},that is, any site is adjacent to at least two sites with distinct symbols. A subshift 
X will be called frozen if it consists of frozen points, equivalently Ax is the diagonal. A 
measure on X will be called frozen if its support consists of frozen points. Note that the 
collection of frozen points of a given topological Markov field X are themselves a topological 
Markov field. 



We derive theorem 6.1 as an immediate corollary of the following proposition: 



Proposition 6.2. Let fi be a shift-invariant Markov random field adapted to Xr with Randon- 
Nikodym cocycle equal to the restriction e^^ on its support where M G ■M.XrXSxr ^■^ ^ Markov 
cocycle which is not given by a shift-invariant nearest neighbor interaction. Then fi is frozen. 

Note that any frozen probability measure is Gibbs with a nearest neighbor interaction 
because the homoclinic relation of the support of the measure is trivial. The intuition 
behind the proof of this proposition is the following. For a Markov cocycle M = YTi '^i^i 
the condition Yll=i c^i > indicates an inclination to raise the height function. However 
(T-invariance implies the existence of a well defined "slope" for the height function in any 
direction. Unless this slope is extremal (equivalently, maximal in some direction), this leads 
to a contradiction. 
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In preparation for the proof, we set up some auxiliary results. 

6.1. Real valued cocycles for measure-preserving Z'^-actions. We momentarily pause 
our discussion about Markov random fields on X^. to discuss cocycles for measure-preserving 
T/' actions. Let (X, J-", /i, T) be an ergodic measure-preserving TJ^ action. A measurable 
function c : X x Z'' — )■ M is called a T-cocyde if it satisfies the following equation /x-almost 
everywhere: 

(6.1) c{x , n + m) = c{x , n) + c{TnX , m) . 

The relevance to our context is as follows: taking T = a to be the shift action, the function 
c : X Z'^ — )■ M given by 

c(x, n) = Xn — Xq where x G Ht and (f>{x) = x, 



satisfies equation (6.1), that is, the difference of heights between various sites gives us a 
Z'^— cocycle. 

We will use the following lemma: 

Lemma 6.3. Let {X, J-", /i, T) be an ergodic measure-preserving Z'^ action and c : X xZ'^ ^ M. 
be a measurable cocycle such that for any n G Z'^ the function fc,n{x) := c(x,n) is in L^{fi), 
then for any n = (ni, n2, . . . , na) G Z'^ 



lim ^ = [ c{x^n)djjL{x) 

e->oo k J 

d „ 

Uj I c{x,ei)dfi{x). 



i=l 

The convergence holds almost everywhere with respect to fi and also in L}{^). 



Proof. By the cocycle equation (6.1) we have: 

fc-i 



c{x,k- n) = ^c(T;x,n). 



i=0 



The existence of almost everywhere and limit f{x) := limfc_>.oo ). follows from the 
pointwise and V" ergodic theorems. It remains to show that the limit is constant. We do 
this by showing that the limit is T-invariant: For any m G Z'^ we have: 

c{x, kn) = c{x,m) + c {TmX, kn) + c {Tm+knX, -m) . 

Thus, 

1 2||m||i 
\f{x) - f{Trn{x))\ < lim - {\c{x,m)\ + \c(Tra+k-nX,-m)\) < lim — = 0. 



Therefore, 



c{x,k-n) f w / X 

lim ; = / c[x,n)ajj{x) 

c-s>oo k J 

d „ 

^n-i c{x,ei)djj,{x). 



1=1 
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□ 



Remark: In the specific case that T is totally ergodic, meaning that the individual action 
of each T„ is ergodic for any n & 1/ \ {0}, the lemma above is completely obvious since 
^^^'^'"^ = I 5^^=o ^{"^n^i which is an ergodic average. 

Corollary 6.4. Let /i be an ergodic measure on Xr, and n — {rii, . . . ,nd) e M.^. Then 
/I- almost surely 

1 

lim - {xikn\ -^o) =^ ^i'^i 

i=l 

where for w — {wi, . . . ,Wd) € M*^, [wj — ([wij, . . . , [w^J) e Z'', x e Ht satisfies 4>r{^) — x 
and 

Vj = iJ,{{x e Xr : Xej — xq = 1 mod r}) — iJ,{{x e Xr : Xej — xq = —1 mod r}) 
/or j = 

6.2. Mciximal height functions. For x e Ht and a finite F C Z'', let 

Hti^^F ^{y e Ht\yn^Xniin^ F}. 

Note that if (f)r{^) — ^ then Htx,F is in bijection with {y e | y„ = x„ if n F} via the 
map 0r- Consider the partial ordering on Htx,F given by y > 5 if y„ > i„ for all n e Z*^. 

Lemma 6.5. Le^ x e i^i and e N 6e given. Then {Htx^r, >) a maximum. If the 
maximum is attained by the height function y then for all n & F: 

yn — min{xfe + | |n — /c| |i | /c G dF}. 

Proof. Given height functions y,z & Ht{x, F), note that the function w defined by 

Wi = max{yi,Zi). 

is an element of Htx,F- 

To see why w is a vahd height function consider adjacent sites i and j eZ^. Then either 

yi>Zi , yj > Zj 
or 

yi<Zi , yj < Zj. 

In either case \wi — Wj\ = 1. This proves that w is a valid height function. Also Wi — 
max(yj, ij) = Xi for all i G F^'. Hence w G Ht^^F- Since Htj- p is finite, it has a maximum. 

Suppose the maximum is attained by a height function y. Let i & F, k & dF and 
(ii — i),i2, ia, ■ ■ ■ , ip, {ip+i — k) he a shortest path between i and k. Then 

p p 

t=l t=l 
Therefore yi < \\i — k\ \ + Xk which proves that 
(6.2) yi<mm{xk + \\i-k\\i\k e dF}. 

For proving the reverse inequality, note that if y has a local minimum at some n & F then 
the height at n can be increased. Since y is the maximum height function, for each n G F at 
least one of the adjacent sites m satisfy y„ — = 1- Iterating this argument, for any i G F, 
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we can choose a path ji, 72,^3, • • • , Jp+i, with ji = i, j2, ...JpeF, jp+i G dF along which 
y is increasing: yj^ — yj^^^ = 1 for all t G {1, 2, . . . ,p}. Then 



t=i 



Combining with the inequality 6.2, we get 

jji = minjxfc + I — A;| |i I /c G dF}. 

□ 



Consider a shift-invariant Markov cocycle M G M-x^- Recall that by corollary 5.4 there 
exists a G M and a Gibbs cocycle Mq G compatible with a shift-invariant nearest 

neighbor interaction such a that M = Mq + aM. The following lemma is based on the idea 
that in the "non-Gibbsian" case a ^ 0, whenever y is much bigger than x, M{x, y) is roughly 
a times the volume of c? + 1-dimensional shape bounded between y and x. 

As before, for N e N, let = {n e Z'^ \ \\n\\i < N} be the N - radius - hall in Z'^ 
centered at the origin. 

Lemma 6.6. Let M = Mo+aM be a shift- invariant Markov cocycle on Xr'^^ where Mq G Qx^^ 

is a Gibbs cocycle compatible with a shift-invariant nearest neighbor interaction, M is the 
Markov cocycle given by formula ( |5.4 ) and a > 0. Then there exist a positive constant 



Ci > (depending only on d) and another positive constant C2 > (depending only on d and 
Mq) such that for all N ^ N and all {x,y) G A^^ satisfying Xi = yi for i G l/\D]^ and 
(x, y) G t^Ht for which x < y we have: 

M{x, y) > cia{yQ - xqY+^ - 02 ■ N'', 

where as usual {x,y) G Am are height functions corresponding to {x,y). 

Proof. Let M = Mq + aM be as given in the lemma. We will first show that there exist a 
suitable constant ci > so that M(x, y) > Ci{xq — yQ^^^ for any (x, y) G A^^ which satisfy 
X < y and ijQ — Xq > 0: 

Since jji — Xi > 0, we have: 

2 

iGDm j=l i£dDj-i 

Since jji - Xi > yQ - Xq - 2\\i\\: 

yp-^p VQ-^o 
2 2 

j=l iddDj.i 3=1 

Setting K = , observe that the sum on the right hand side is roughly the volume of 
d + 1 dimensional "cone" of height K and base Dk- Thus, the sum is proportional (within 
constants depending only on d) to K'^'^^. To make this precise, we use the naive estimates 
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I^^.l > i'Y--,') > ^f-' and 

K rK-1 



y^f-^{2K -2j)> j x'^-\2K -2x)dx. 



This establishes the constant Ci > so that M{x, y) > Cia{xQ—yQY~^^ (technically, the case 
K = 1 requires separate consideration, but this is easily handled by reducing the constant 
ci). 

We now show that for any Gibbs cocycle Mq corresponding to a shift-invariant interaction 
(f) there exists a suitable constant C2 > so that \MQ{x,y)\ < C2N'^ whenever {x,y) G Ax,, 
satisfy Xn 7^ yn for all n E \ D^'- Write 

where : B{Xr) — M is a translation invariant nearest neighbor interaction corresponding to 
Mq, and the sum is over all cliques C (edges and vertices) in Z'^ intersecting Djy. Therefore 

\Mo{x,y)\< J2 E \<Pi^c) - <P{yc)\ 

and it follows that |Mo(x,?/)| < C2\D]^\ where c'2 = s'^p{J2cn{o}jtd \^(^c)\ '■ ^ ^ ^r}- Since 
Dn < 2'^N'^, it follows that \Mo{x,y)\ < CiN^ with cs = 2'^c'2. 
Putting everything together, we conclude that 

M(x, y) > aM{x, y) - |Mo(x, y) \ > Cia{xo - yoY+^ - C2 ■ iV^ 

as required. 

□ 

For the same hypothesis except if a < 0, we get, 

M(x, y) < cia ■ K'^+^ + csiV^ 
for the same constants Ci, C2 > 0. 

Lemma 6.7. Let fi be a shift-invariant measure on and n eT/ such that ||n|| = 1. If 

/i({x G Xr : Xo — Xn = 1 mod r}) = 1, 

then fi is frozen. 

Proof. If /i({x E Xr : Xq — Xn = I mod r}) = 1, then /x-almost surely Xm-n = a^m + 1 
mod r and Xm+n = ~ 1 for all ^ £ '^'^i so yU-almost surely x is frozen. □ 

In the course of our proof, it will be convenient to restrict to ergodic shift-invariant Markov 
random fields. The following claim justifies this: 

Theorem 6.8. Any shift-invariant Markov random field /i with specification is in the clo- 
sure of the convex hull of the ergodic shift-invariant Markov random fields with specification 

e. 

Proof. See Theorem 14.14 in [H]. □ 



We now proceed to complete the proof of proposition |6.2 
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Proof. Since a convex combination of frozen measures is frozen, by theorem 6^ it suffices 
to prove that any ergodic Markov random field /i adapted to with its Ra don-Nikodym 
cocycle equal to on its support where M = Mq + aM (as in corollary 5.4) and a 7^ is 
frozen. 

Choose any /i satisfying the above assumptions, assuming without loss of generality that 
a > 0. Let 

Vj = fi{{x G : Xq — Xe = 1 mod r}) — fi{{x E Xr : Xq — Xg. = —1 mod r}) 



for j = 1, . . . , d. If \vj\ = 1 for some 1 < j < d, it follows from lemma 6.7 that /i is 
frozen. We can thus assume that \vj\ < 1 for all 1 < j < d. Choose e > satisfying 
e < I min{l — \vj\ : 1 < j < d}. 

Let dB = {t eM.'^ : = 1} , and choose points t^^\ . . . ,t^^'^^ G dB which are e-dense 
in dB with respect to the norm || ■ By this we mean that for any t G dB there is some 
/ G {1, . . . ,M} so that ||t - < e. For A; G N, let 



M d 



Ak = G Xr : \{xo) -^Lfc.tWj -k^Vjt'-pl < 2ek}, 

1=1 j=i 

where for v = {vi, . . . ,Vd) G M*^, [v\ = ([fij, . . . , [fdj) ^ It follows from corollary 6.4 



that for sufficiently large k, fi{Ak) > 1 — e. It follows in particular that there exists x E 
such that fJ'{[x]QD,.) > and fJ,{Ak \ [xjoDj > 1 — 2e. Let x be as above. 
Because {t^^\ . . . , t^^'^^} are e-dense in dB, it follows that 

d 

(6.3) yo — Xn < VjTij + 3e/c, 

i=i 

for any y E A^Pi [xja^j. and n E dD^. Choose z which is maximal in Ht{x, D^), and let 



(z). It follows from lemma 6.5 that for some n E dD 



(6.4) zo-Xn = \\n\\i. 



by lemma 6.6 



Equations (6.3) and (6.4) together imply that zq — yo > ke for any y E AkH [x]dDk- Thus, 



M{y, z) > cia{k ■ e f+^ - caA;'^ > Ca^'^+S 

the last inequality holding for some C3 > 0, when k is sufficiently large. 
It follows that 

K[z]f, I [x]dDj > K[y]D, I Haoje"^^"^'. 

Now since Ak fl [x]9d,. = [Jy{[y]Dk H [xja/j^), where the union over all y E Bn^^Xr) such that 

[yjok l~l Ak n [x]dDk 7^ 0- Thus Ak is a union of at most \Bof.udDk{Xr)\ = e^^^'^^ elements. It 
follows that fi{Ak I [x]9z)j.) — )■ as — 00, in contradiction to our choice of x which had 
implied that fi{Ak \ [x]sDf.) > 1 — 2e. □ 

7. NON FROZEN ADAPTED SHIFT-INVARIANT MARKOV RANDOM FIELDS ON Xr ARE 

FULLY-SUPPORTED 

We have concluded that any shift-invariant Markov random fields which is adapted with 
respect to Xr is a Gibbs measure for some shift-invariant nearest neighbor interaction. Our 
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next goal is to show that any such measure must be fully-supported on X,.. For somewhat 
related results with similar argument, see section 4.3 of [20]. 

Proposition 7.1. Let r > 3 be an odd integer, and let fi be a shift-invariant Markov random 
field adapted with respect to X^.. Then either supp{fi) = X^. or fi is frozen. 

Roughly speaking we shall show that for non-frozen shift-invariant Markov random fields 
the height function corresponding to a typical point is "not very steep". Given a height 
function that is "not very steep" , there is enough flexibility to "deform" the height function 
while keeping it fixed outside some large ball, in such a way that the restriction of the 
"deformed" height function in a fixed finite set projects to any word in the language of Xr. 
For an adapted Markov random field, the "deformed height function" corresponds to a point 
in the support as well, which will be the key to proving the required result. 

We first set up some technical details. For x G Xj. and a finite set A G Z'^ denote: 

RangcAix) = max \xn — £m\, 

n,m(iA 

where x G Ht is a height function associated with x by (t){x) = x. 

Lemma 7.2. ( "Extremal values of height obtained on the boundary") Let F C Z'^, 
and suppose x & Xr such that RangcQpix) > 2. Then there exists y G Xj. such that y = x 
on -F^ and 

Rangepiy) = RangcQpiy) — 2 = Rangegp^x) — 2. 

Proof. Fix a height function x such that (f){x) = x. Denote T := max{x„ : n G dF}, 
B := min{xn : n G dF}. Let k denote the sum of the absolute value for the deviations xp 
from the interval {B,T). That is 

k := max(x„ — T -|- 1, i? — -|- 1, 0), 

We prove the claim by induction on this number k. If = then y = x already satisfies 
the conclusion of this lemma because 



Rangepix) = maxXm — minXm < (max Xm — 1) — ( + 1) 

m£F m£F m£dF mGdF 

= Rangegp{x) — 2. 

Now suppose A; > 0, and let n G -F be a point where x obtains an extremal value for 
F U dF. Without loss of generality suppose, 

meFUdF 

Since all neighbors of n are in F U dF, it follows that Xm = Xn — 1 for all m adjacent to n. 
Therefore the function y G Z^"* given by 



— 2 for m = n 
otherwise 



is a valid height function. Hence we have lowered the height function at site n. Since 
Rangegp{x) > 2, it follows that t/n is neither a minimum or a maximum for ^ in F U dF. 
Thus, we can apply the induction hypothesis on y = p{y) and conclude the proof. □ 

22 



Lemma 7.3. ("Flat extension of an admissible pattern") Suppose x E Xr and N e 
N. Then there exists y & X^. such that y — x on £>Ar+i and 



for alll<k< 



RangedDj,+^{y) = RangedDj,{x) - 2k, 

Rangegoj^ (x) 



Proof. We will prove the following statement by induction on M G N: For any N & N and 
any height function on x on D^+i+m with RangcQo^x — 2M there exist a height function y 
on Dtv+i+m such that y — x on D^^i and for any 1 < k < M and RangeoOff+kiy) — 2M—2k. 
Observe that the height function y satisfies in particular RangcdDN+Miv) ~ 0- Thus, the 
outermost boundary of y is flat and it can be extended to a height function on Z*^, so the 
lemma will follow immediately once we prove the statement above for all M e N. 

For basis case of the induction, there is nothing to prove. Assume the result for some 
M e N. Let X e Xrhe a, height function y on £)jv+i+(m+i) such that RangeQDr^x — 2(M+1). 
Denote N := N + I + {M + I) = N + M + 2. Let n e Dff\ Dn+i be a site where x obtains 
an extremal value for \ Djv- If there is no such site then 

Rangegor^+iix) = max x„, - min x.^ 

— ( max Xm — — { niin Xm + 1) 
= 2M 

proving the induction step for that case. Without the loss of generality we can assume that 
it is a maximum, that is. 



Then the function y given by 



a m = n 
otherwise 



is a valid height function on D^. Hence we have lowered the height function at the site n 
of X. Repeating the steps for sites with extremal height (formally, this is another internal 
induction), a height function z can be obtained on Df^ such that z — x on D^+i and 

RangcdDN+A^) = 2M. 

Since = (A^ +!) + ! + M, we can apply the induction hypothesis to substituting A^ + 1 
for A^. Thus, we can now obtain a height function y on Dfj such that y = x on D^+i and 



for 1< A; < 



RangcQDj^+^iy) = RangedD^{y) - 2k 

RangeQDfjiv) 



2 

This completes the proof of the statement. □ 

Lemma 7.4. ("Patching an arbitrary finite configuration inside a non-steep 
point") Let r > 3 be some integer and N,k eN. Choose y & X^. which satisfies 
RangedD2N+2r+k+iy — ; o,iT'd any x e Xr- Then: 
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(1) If either r is odd or x„ — 1/„ is even for all n G Z*^, then there exists z G X,. such that 

Xn if n E Dn 

Vn if n & -D2Af+2r+A:+l 

(2) Otherwise r is even and x„ — ?/„ is odd for all n G Z'^ , then there exists z & Xr such 
that 



Zrt 



ifneDN 

Vn if n G -D2Ar+2r+fc+l 



The idea of this proof hes in the use of lemmata 7^ and 7^ Given any configuration 
on Djsf we can extend it to a configuration on D2N with fiat boundary which than can be 
extended to y a httle further away provided the range of the height function is not too large. 
A slightly different treatment is required for when r is even and when it is odd because the 
parity does not change according to the graph distance in the odd case. 



Proof. By applying lemma 7^ k times we conclude that there exists y^^^ G Xr such that 
yW = yon Z^^^+ar+fc+i and 

RangeaD^rf+2r+i{y^^^) = 0- 
Equivalent ly, t here exists a G so that yli^ = a for all n G dD2N+2r+i- 



By lemma 7^ choose x^^^ G Xr such that x^^^ = x on and 

RangedD:,j^_-,ix^^^) = 0. 

Equivalently, there exists 6 G Z^ so that Xn ■* = b for all n G dD2N-i- 
If we are in case (1), either r is even and b = a mod 2 or r is odd. Either way, there is 
some integer k E [0, . . . r — 1] such that a+k = b—k mod r. Thus, we can find y^'^\x^'^^ G Xj., 
so that y^'^^ agrees with y^^^ outside D2N+2r, x^"^^ agrees x^^^ in D2N, and so that both x*-^^ 
and y^"^^ have a common constant value a + k = b + {r — k) mod r on dD2N+r-k- Thus, we 
get the required 2; G by setting 



xi^) for n G 

for n G L'^^+fc 

To prove case (2) we follow the same procedure, substituting xhy ae^x. □ 
We can now conclude the proof of proposition |7.1 



Proof. As in the proof of proposition 6.2, let be a shift-invariant Markov random field and 
Vj = /i({x E Xr : Xq — Xe^ = 1 mod r}) — fi{{x E Xr : Xq — x^^ = —1 mod r}) 



for j = 1,. . . Assume that supp{fi) is not frozen. Then by lemma 6.7, \vj\ < 1 for all 
1 < j < c^- Again, choose e > satisfying e < ^ min{l — \vj\ : 1 < j < d}. 

We need to show that for any iV G N, and any configuration c G Boj^^Xr), Ai([c]Djv) > 0. 



Using corollary 6.4 it follows that for sufficiently large k, 



fi{{y G Xr : Rangeao^iy) < 2(1 - e)k}) > 1 - e. 



■'k 
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Now choose k > {2N + 2r + 1) large enough so that for some y G X,. with 
RangcQD^y) < 2(1 - e)k < 2{k - {2N + 2r + 1)) 



and fi([y]£)f.+i) > 0. By lemma 7.4, it follows that there exists z G Xr with Zn = yn for 
n \ -Dfc and z„ = c„ for n G -Dat- Since /i is an adapted Markov random field, it follows 
that IJ'{[z\d,,+i) > 0, and in particular yu([c]Djy) > 0. 

□ 



8. Fully supported shift-invariant Gibbs measures on X 



r 



Next we demonstrate the existence of a fully-supported shift-invariant Gibbs measure for 
shift invariant nearest neighbor interactions on X,.. By proposition 7. If this is equivalent to 



the existence of a non-frozen Gibbs measure. We will obtain these by showing that equi- 
librium measures for certain interactions are non-frozen. To state and prove this result, we 
need to introduce the notion of (measure-theoretic) pressure and equilibrium measures and 
apply a theorem of Lanford and Ruelle relating equilibrium measures and Gibbs measures. 
Our presentation is far from comprehensive, and is aimed to bring only definitions necessary 
for our current results. We refer readers seeking background on pressure and equilibrium 
measures to the many existing textbooks on the subject, for instance [HI 125] . 

Let /i be a shift-invariant probability measure on a shift of finite type X. The measure 
theoretic entropy can be defined by 

where if^* is the Shannon-entropy of fi with respect to the partition of X generated by 
Di, the definition of which is given by: 

with the understanding that OlogO = 0. 

Given a continuous function / : X — )> M, the measure-theoretic pressure of / with respect 
to /i is given by 

A shift-invariant probability measure yU is an equilibrium state for / if the maximum of 
V Pu{f) over all shift-invariant probability measures is obtained at /x. The existence of 
an equilibrium state for any continuous / follows from upper-semi-continuity of the function 
u I— )• Pu{f) with respect to the weak-* topology. 

Let be a nearest neighbor interaction on X. Define a function : X — t- M by 

A finite | (0,0)gAcZ'' 

The following is a restricted case of a classical theorem by Lanford and Ruelle: 



Theorem. (Lanford- Ruelle theorem Let X be a 7/-shift of finite type and a 

shift-invariant nearest neighbor interaction. Then any equilibrium state fi for the f^ is a 
Gibbs state for the given interaction cj). 
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The topological entropy of a Z'^-subshift X can be defined by 

h{X)=\im ^log\Bo,{X)\- 

fc— >oo i^fc 

We recall that the well known variational principle for topological entropy of Z'^-actions, 
which (in particular) asserts that h{X) = sup^ h,^ whenever X be a Z'^-shift space and the 
supremum is over all probability measures on X. 

Lemma 8.1. Let M be a Gibbs cocycle on X^ with a shift-invariant nearest neighbor inter- 
action. Then there exists a shift-invariant nearest neighbor interaction (p such that M = 
and any equilibrium measure for f^ is non-frozen. 



Proof. Let (x*^*-*, y*^*-*) G be as in the proof of proposition 5.2, If M G Qxr then there 
exists a shift-invariant nearest neighbor interaction so that 

M(x«,i/«) = 0([z + 2]o)-0([^]o) 

r-l 
j=0 

Furthermore, we can choose an interaction to be such that 

(f){[i, i + = (f){[i -\- 1, i]j) = ai for all i E Zr and j G {1,2, ... ,d} 
and 0([«]o) = for all i E^L^. For such an interaction we have 

/d r—\ 
f^{x)d[i{x) = YY(l)j{i,i + l)^{[i,i + l]j) + ^j{i + l,i)ix{[i + l,i]j) 
j=l 1=0 
d r-l 

= E + 

j=l i=0 

Let a = ma.xi<i<r CLi attained by a^Q. It follows that for any shift-invariant probability 
measure 

f(j){x)dfi{x) < d ■ a 



with equality holding iff i + = fi{[i + 1, i]j) = for all ai < a and j = 1, . . . ,d. 

For a frozen measure fi it follows that for some j G {1,2, .. . ,d}, fi{[i,i + > or 
fi{[i + 1, i]j) > for alH G {0, 1, . . . , r — 1}. Thus if < a for some < z < r — 1, it follows 
that for any frozen measure /i, 

fn{x) < sup j fdu{x). 

where the supremum is attained by the measure supported on the orbit of the point periodic 
point X E Xr given by 

io odd 
io + I \\n\\i even 

It is easily verified that if fi is frozen then /i^ = 0. Thus in this case, for any frozen probability 
measure n 

PM<f>) = J f<f>{x)K^) < sup j f4>{X)dv{x) < supP^(/^) 
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Xr. 



and in particular any frozen measure /i can not be an equilibrium measure for /y. 

The remaining case is when Oj = a for all i, in which case f^{x) = d-a is constant. Thus, by 
the variational principle sup^ Pv{.f) = (i-a+sup^ hy = d-a+h{Xr). Since h{Xr) > 0, it follows 
that the strict inequality P^{f(j,) < sup^ PvWd)) holds also in this case for any frozen measure 
/i. Thus we have the result that for a given Gibbs cocycle with a shift-invariant nearest 
neighbor interaction there exists an interaction for that cocycle such that the corresponding 



equilibrium state is not frozen. By proposition 7.1 the proof is complete. □ 



Corollary 8.2. For any shift-invariant Gibbs cocycle M on there exists a shift-invariant 
nearest neighbor interaction (p on X^ with M = M^, and a corresponding shift-invariant 
Gibbs state v with supp{v) = X^. 



Proof. By lemma 8.1 , there exists a nearest neighbor interaction V on Xj. with M = and 
an equilibrium measure /i for which is non-frozen. By the Lanford-Ruelle theorem such 
/X is a Gibbs state for 0. □ 



9. "Strongly" non-Gibbsian shift-invariant Markov random fields 

In this section we demonstrate the existence of shift-invariant Markov random fields for 
whose specification is not given by any shift-invariant finite range interaction. Our example 
proves that in general, in contrast to shift-invariant finite range interactions, the specification 
of a Markov random field cannot be "given by a finite number of parameters" . 

Let A be the alphabet consisting of the following 18 tiles, shown in the figure below: There 
is a blank tile, a "seed" tile (marked in the figure with "0"), 8 "interior arrow tiles", 4 of 
which correspond to the cardinal directions and 4 corresponding to "corner directions" and 
8 additional "border arrow tiles" (marked in the figure with and extra mark "B"). 

Blank Tile Square Tiles 
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All tiles other than the blank tile will be called square tiles and the tiles with arrows will 
be called arrow tiles. The arrow tiles with 'B' will be called border tiles and those without 
'B' will be called interior tiles. Configurations of an (2n + 1) x [2n + 1) square whose inner 
boundary consists of border tiles as shown in the figure below will be called an n-square: 
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,that is configurations surrounded by border tiles will be referred to as squares. The idea is 
to have the interior tiles form squares with a seed tile in the center and border tiles on the 
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boundary "floating in the sea of the blank tiles" . A configuration in general should look like 
the figure below. 





Bp) 




B y 


D ^ 


B 

~\ 












B y 


B ^ 


B ^ 




























Tb 
















t. 


















Tb 


T 




— > 










B 


















/K 
B 


T 


/\ 








■ / 








<" 














/\ 
B 


r 


T 






i 


B 














V 








B 


r 


■\ 


< 


< 


/J 


B 

\/ 























B 


^B 


^B 


B 


^B 


^B 


, B 


















B 





















































Let X be the nearest neighbor shift of finite type on alphabet A with constraints given by 

(1) Any "arrow head" must meet an "arrow tail" of matching type. 

(2) Adjacent arrow tiles should not point in opposite directions. 

(3) Two corner direction tiles cannot be adjacent to one another. 

(4) The seed tile is surrounded by arrow tiles on all sides. 

(5) An interior tile is always surrounded by other square tiles while a border tile has an 
interior tile on its right and the blank tile on its left. 

Clearly X has positive entropy. Denote by Bn C the set € Z^ | \ j\ < n} . 

Proposition 9.1. Let /i be any measure of maximal entropy for X. Then /i is fully- 
supported. 

Proof. Let fi he a measure of maximal entropy for X. Our first observation is that ^- 
almost surely there is no infinite connected component composed of square tiles. An infinite 
connected component can be either an infinite sized square, a corner or a periodic point 
composed of one of the arrow tiles. Being transient events, by Poincare recurrence theorem 
the probability of having a corner or an infinite sized square is 0. Since /x is a measure of 
maximal entropy for X, the measure of periodic points is as well. Thus the observation 
has been verified. Let a; G X be an element such that it does not have any infinite connected 
component composed of square tiles. We will now show for all r e N that there exists 
a finite set such that C A^ C and Xi is the blank tile for all i e dAr. Let 
5*^1 G A'^^,Sq2 G A''-^^, . . . Sqk G A'^^'' be an enumeration of the squares in x such that 
Ci n Br+i ^ (j) . Let 

A = ^i=lCi U Br. 

Since every square is surrounded by the blank tile, Ar has the required properties. 

Now consider any element y & X. By completing the incomplete square in yl^^ we obtain 
a. z & X such that 




Vi for i G B, 

blank tile for i E B' 



Now choose any x G supp^j) which does not have any infinite connected component 
composed of square tiles. By the previous argument, find A^r C such that i?4r C A^r and 
Xi is the blank tile for all i G dA4j.. Then z — x on dA^r- By Lanford-Ruelle theorem is a 
Markov random field with the uniform specification adapted to X. Therefore 

^^{[z\AvJ^A) ^ ^ 

IJ'{[x\AVJdA) 
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proving = A*([|/]b„]) > 0. Since this is true for any n E N we can conclude y e 

supp{ii). But the choice of y e X is arbitrary. Hence supp{^) = X. 

□ 

To obtain a space such the dimension of the Markov cocycles is infinite let F be a nearest 
neighbor shift of finite type with the alphabet as in figure 1 but now with two types of square 
tiles, type 1 and 2. The adjacency rules are as in the subshift X but also that adjacent square 
tiles must be of the same type, that is, any square in an element of Y will consist entirely of 
tiles of type 1 or of type 2. Let p G (0, 1)^ and : Y — y X be the map which forgets the 
type of square tiles. We will now construct a shift-invariant Markov random field /^p obtained 
by picking a particular configuration in X according to a measure of maximal entropy and 
then choosing the type of every i-square to be 1 with probability pi and 2 with probability 
l—Pi- A more precise description follows. Let J-" = 0~^(i5(X)) be the pull-back of the Borel 
sigma-algebra on X. For any y e i £ N and A C finite consider the functions 

"^a(?/) — the number of i-squares of type 1 in y intersecting A 

and 

^A(y) — tli6 number of i-squares of type 2 in y intersecting A. 
//p is the unique probability measure on Y satisfying /ip|j^ = o and 

oo 



for all Kdl? finite, y eY. 

Note that //-almost surely configurations in X has no infinite-sized squares so /i-almost 
surely the mj's and n^'s account for all the squares intersecting A. 

Proposition 9.2. For any p e (0, 1)^, the measure /ip defined above is a shift-invariant 
Markov random field. 

Proof. Let (y, y') e Ay and F = {i e | y^ ^ y^}. Then 



n 



FUdF 



(y) - n'pudFiy') = n\{y)-n\{y'). 



for A D F U dF finite. Therefore it is sufficient to prove that Mp : Ay — )■ M given by 

i^p{[y\FvjdF\J^){y) 

oo 

= ^{'>^FvjdF{y') - T^Fudpiy)) iog(Pi) + (nFuaF(y') - T^Fudpiy)) iog(i - Pi) 

i=l 

for all (y, y') G Ay and F = {i G | yj 7^ y^} defines a shift-invariant Markov cocycle. Let 
i G N be chosen. We will verify that M : Ay — > M 

M(y, y') = m'p^jgpiy) - m'p,jQp{y') 

for F, y, y' as above defines a shift-invariant Markov cocycle. By linearity of shift-invariant 
Markov cocycles this is sufficient. 
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Given {y,y'),{y',y") e Ay, 

F^{ieZ' I y, ^ yl or y', ^ y'l) 

and A D F U finite it follows that 

M(y, y') + M{y', y") = mi{y) - mi(y') + m^y') - mi{y") = M(y, /)■ 

This proves that M is a shift-invariant cocycle. To complete the proof we need to verify 
that for any {y^y') G Ay, M{y,y') depends only on the sites where y and y' differ and its 
boundary. As before let {y.y') G Ay and F = {i E Z,"^ \ yi ^ y^}. For each square in y 
intersecting F U dF there is either a crossing between the horizontal sides in F U dF or a 
crossing between the vertical sides in F'^. Here a crossing is a path from one side of the square 
to its opposite side where diagonal steps are allowed. In the former case the subconfiguration 
on F U dF determines the entire square and in the latter the subconfiguration of F^ does 
the same. Consider the function gf" such that gf{x) is the number of i-squares of type 1 
intersecting A in a; which are determined by the subconfiguration on A for every x & Y . 
Then it follows that 

M{y,y') = m'p^Qpiy) - m'p^Qp{y') = gpudFiy) - dFudpiy') 

is dependent exactly on ylruOF and y'lrudF- D 

This proves existence of uncountably many linearly independent shift-invariant Markov 
cocycles which have corresponding fully-supported shift-invariant Markov random fields. 
Since the space of Markov cocycles which come from some finite range shift-invariant is 
a union of finite dimensional vector spaces, this further implies that there exists a shift- 
invariant Markov random field which is not Gibbs for any shift-invariant finite interaction. 
Alternatively, note that for any Gibbs cocycle with shift-invariant finite range interaction 
the magnitude of the cocycle at a particular homoclinic pair is at most linear in the size of 
the sites at which the two configurations differ. We can choose a p e (0, 1)^ such that this 
does not happen. 

A simple variation on the above construction yields topological Markov fields which are 
not sofic: Choose p e [0, 1]^. If — or = 1, this would disallow squares of certain 
types for specific sizes. Each such p would determine a shift-invariant Markov random field 
supported on a shift space contained in Y. Since there are uncountable many such subshifts 
many such spaces would be not sofic. However it is easy to see from the proofs above that 
these are global topological Markov fields. 

10. Conclusion and further problems 

In this paper we demonstrated the applicability of Markov cocycles to studying Markov 
random fields and Gibbs states with nearest neighbor interaction. In cases where the space 
of shift-invariant Markov cocycles is finite dimensional, these can act as a substitute for 
nearest neighbor interactions in providing a description of the specification "using finitely 
many parameters" . There are several questions which remain to be answered. We mention 
a few here. 

Question 1: What characterizes the property of being the support of a shift-invariant 
Markov random field on the Calyey graph of Z'^? We know it is equivalent to being a non- 
wandering nearest neighbor shift of finite type when d — 1. For finite graphs, it suffices to be 
a topological Markov field. In higher dimensions we wonder whether it is sufficient to have 
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a topological Markov field with a shift-invariant probability measure supported on it. Also: 
Suppose a Z"^ shift of finite type is the support of some shift-invariant Markov random field. 
Must it also be the support of a shift-invariant Gibbs measure for some nearest neighbor 
interaction? 

Question 2: In this paper we prove that the dimension of the space of shift-invariant 
Markov cocycles on Xr is r and that of Gibbs cocycles with shift-invariant nearest neigh- 
bour interactions is r — 1. Moreso we prove that any shift-invariant Markov random field 
adapted to these spaces has a shift-invariant nearest neighbour interaction. Finally we prove 
that corresponding a given shift-invariant Markov cocycle there exists a fully supported 
shift-invariant Markov random field if and only if it is Gibbs with a shift-invariant nearest 
neighbour interaction. Suppose we are given a nearest neighbor shift of finite type with the 
pivot property along with its globally allowed patterns on {0} U <9{0}. Is there an algorithm 
to determine the dimension of the shift-invariant Markov cocycles? If so, is there a way to 
decide which of these cocycles have a corresponding fully supported shift-invariant probabil- 
ity measure on the subshift? In case the subshift has a safe symbol, such an algorithm can 
be derived via from the proof of the Hammersley- Clifford theorem [7] and also from Lemma 
3.1 in [8]. Note that it is not hard to see that given this information there is an algorithm 
to determine the dimension of the space of Gibbs cocycles with shift-invariant finite range 
interactions. Specific models of interest would be r-colorings of 7? with r > 6 and domino 
tilings of Z^(with the generalized pivot property). One can also question how much does the 
underlying graph effect these results. For instance, we know that that every shift-invariant 
Markov random field is Gibbs with a shift-invariant nearest neighbour interaction when the 
underlying graph is Z [6] and every Markov random field is Gibbs with a nearest neighbour 
interaction when the underlying graph is finite and decomposable, that is, a graph which 
can be decomposed into triangles and edges [T5]. 

Question 3: In section [9} we construct a subshift such that the dimension of the space 
of shift-invariant Markov cocycles is uncountable. However this space does not have any 
nice mixing property like block gluing or strongly irreducible [2]. Does there exists a subshift 
which is strongly irreducible or even block gluing such that the dimension of the space of 
Markov cocycles is uncountable? 
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